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Shawmut  students  display  their  mixed-media  horses 
created  with  residency  artist  Cheryl  Bannes 
of  the  Lewistown  Art  Center 
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Executive  Summary 


The  Montana  Arts  Council  (MAC)  views  assessment  and  evaluation,  that  result  in  continuous 
learning  and  program  improvement,  as  an  essential  element  of  a high  quality  and  cost  effective 
arts  education  program.  This  evaluation  report  is  summative,  covering  a three-year  time  frame 
(FY  2003  - FY  2005),  coinciding  with  the  grant  period  for  MAC’s  National  Endowment  for  the 
Arts  partnership  grant.  The  Arts  Education  program  director  hired  Pam  Mavrolas  of  Mavrolas 
and  Associates  to  assist  the  agency  in  its  evaluation  efforts.  The  goals,  strategies  and  evaluation 
questions  articulated  in  this  plan  were  developed  directly  from  the  framework  provided  by  the 
Montana  Arts  Council’s  2001  - 2006  Strategic  Plan,  and  are  written  to  be  specific,  measurable 
and  time-limited. 

1.  Areas  of  Accomplishment  and  Success 

Three  -Year  Summative  Findings 


1.  The  Montana  Arts  Council’s  Arts  Education  program  is  a successful,  valued  and  cost 
effective  residency  program  providing  artistic  programming  of  high  quality  in 
Montana’s  urban  and  rural  schools  and  communities.  The  Arts  Education  program,  with 
few  exceptions  met,  and  in  several  areas  exceeded,  the  goals  and  benchmarks  enumerated  in 
its  evaluation  plan.  The  Arts  Education  program  staff  has  demonstrated  creativity,  forward 
thinking  and  planning,  commitment  and  prudent  management  of  resources  in  carrying  out  the 
mission  and  activities  of  the  Arts  Education  program  over  the  past  three  years. 

2.  The  Arts  Education  Residency  Program  is  doing  an  outstanding  job  of  utilizing  its  limited 
resources  to  deliver  a quality  program  over  a large,  sparsely  populated  state.  Fifty-five 
out  of  Montana’s  56  counties  have  hosted  at  least  one  residency  since  the  beginning  of  the 
agency’s  current  five-year  strategic  plan  period  (FY  2001-  FY2006). 

3.  MAC’S  Arts  Education  program  is  a lifeline  for  many  really  rural  schools,  sometimes 
providing  their  only  funding  and  opportunities  for  arts  education.  The  majority  of 
residencies  and  resources  were  granted  to  rural  underserved  schools. 


FY2003 

FY  2004 

FY  2005 

Totals 

Number  of  residency  grants 

46 

52 

48* 

146 

Urban 

13  (28%) 

18  (35%) 

14  (29%) 

45  (31%) 

Rural  underserved 

33  (72%) 

34  (65%) 

34(71%) 

101  (69%) 

Dollars  granted  to  all  residencies 

$75,144 

$76,100 

$86,658 

$237,902 

Dollars  granted  to  urban  residencies 

$16,100 

$16,215 

$19,445 

$51,760 

Dollars  granted  to  rural  residencies 

$59,044 

$59,884 

$67,214 

$186,142 

*Six  of  these  grants  are  larger  two-year  grants  that  delivered  residency  activities  to  148  schools  and  1 7 
after  school  or  community  sites  in  FY  2005. 

4.  Arts  Education  program  service  to  Indian  reservations  is  improving.  From  FY  2003 
through  FY  2005  ten  residency  grants  were  given;  seven  on  the  Flathead,  one  on  the 
Blackfeet  and  two  on  the  Northern  Cheyenne  Reservations.  In  addition,  in  FY  2005  the  two- 
year  grantees,  Artmobile  and  Custer  County  Art  and  Heritage  Center,  presented  residencies 
on  the  Rocky  Boy,  Blackfeet,  Fort  Belnap,  Fort  Peck,  Crow  and  Flathead  Reservations. 
Engaging  native  artists  in  residencies  on  their  reservations  proved  less  successful,  although 
there  is  some  movement  in  this  area.  One  Blackfeet  Reservation  residency  was  conducted  by 
a local  artist  and  each  year  one  of  the  funded  residencies  on  the  Flathead  Reservation 
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involved  local  artists  and  tribal  elders.  Only  one  new  native  artist,  a Navajo,  has  been  added 
to  MAC’S  Artist  Registry  since  FY  2003.  In  FY  2005  the  Arts  Education  program  initiated  a 
number  of  activities  that  changed  its  approach  to  offering  residencies  on  reservations.  (See 
page  6 of  the  full  report.) 

5.  An  average  of  28%  of  the  applicant  pool  are  new  to  the  Arts  Education  program, 
providing  a good  balance  between  experienced  sponsors  that  could  continue  to  grow  and 
develop  programs  in  their  schools  and  communities  and  new  communities  and  schools  that 
would  expand  the  Arts  Education  program’s  reach. 

6.  Classroom  teachers  rated  artist  residencies  very  positively.  When  asked  how  they  would 
rate  the  overall  experience  of  their  FY  2004  and  2005  residency  most  said  “outstanding.” 
Their  average  response,  over  two  years,  was  4.8  on  a 5.0  scale  (1  “very  negative”  and  5 
“outstanding”). 

7.  Teaching  artists  value  and  enjoy  their  work,  are  experienced  in  working  in  school 
settings,  and  are  interested  in  continuing  their  involvement  in  MAC’S  Arts  Education 
program.  In  FY  2005  resident  artists  was  asked  about  his  or  her  level  of  satisfaction  with 
their  residency.  Artists  gave  an  average  score  of  4.7  on  a 5.0  scale  (1  “very  negative”  and  5 
“outstanding”). 

8.  Teachers  and  visiting  artists  are  practicing  a high  degree  of  collaboration  in  the 
planning  and  implementation  of  residencies.  When  artists  and  teachers  were  asked  to  rate 
the  quality  of  their  collaboration  on  a five-point  scale  (1  is  “very  negative”  and  5 
“outstanding”)  the  average  responses  were;  artists  4.7  and  teachers  4.8. 

9.  Significant  progress  was  made  over  the  course  of  the  three  years  in  the  areas  of 
planning  and  evaluation,  particularly  in  the  area  of  setting  clear  learning  objectives  for  each 
residency,  the  result  of  multiple  strategies  by  MAC. 

10.  Residency  activities  were  thoughtfully  integrated  with  classroom  curriculum.  Eighty- 
eight  percent  of  the  FY  2004  and  86%  of  the  FY  2005  grantees  reported  that  the  residency 
was  well  integrated  into  the  classroom  curriculum  or  community  arts  organizations’  on-going 
programs. 

11.  Community  support  and  participation  continues  to  be  one  of  the  hallmarks  of 
Montana’s  Arts  Education  program.  Schools  are  often  a central  gathering  place  especially 
in  very  rural  communities. 

12.  Teachers,  sponsors  and  artists  experienced  the  Arts  Education  program  director  as 
responsive,  helpful  and  competent.  In  FY  2003  74%,  FY  2004  83%  and  FY  2005  83%  of 
the  grant  applicants  received  some  level  of  technical  advice  or  assistance  from  the  Arts  in 
Education  director,  primarily  in  creating  their  residency  to  meet  the  program  guidelines. 

13.  The  Arts  Education  program  is  operating  at  maximum  capacity  with  its  current 
resources.  Furthermore,  MAC  anticipates  a small  reduction  in  funds  for  the  coming  three 
years.  Therefore  without  an  infusion  of  new  and  significant  funding,  just  continuing  the 
current  level  of  programming  will  be  challenging  and  new  initiatives  or  activities  will  be 
difficult,  if  not  impossible  to  undertake. 
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Initial  Findings  from  the  FY  2605  PrograiB  Changes 


14.  Two-year  grants  to  exemplary  sponsors  proved  to  be  an  effective  grant-making  strategy 

for  a number  of  reasons  expressed  by  grantees  and  observed  by  the  Arts  Education  program 
director.  Five  grants  totaling  $41,900  were  made  and  14,686  students  were  reached  (50%  of 
the  total  number  of  students  reached  in  FY  2005).  MAC  plans  to  continue  this  grant-making 
strategy,  and  expand  it  if  there  are  more  qualified  applicants. 

15.  The  Arts  Education  program  staff  took  steps  to  further  develop  the  Statewide  Players 
Arts  Education  Network  in  FY  2005.  While  enthusiasm  at  the  first  meeting  was  high  and 
the  need  apparent,  MAC  will  need  to  provide  the  focus,  energy  and  leadership  necessary  to 
developing  this  network. 

16.  The  AlE  director  increased  her  visits  to  ten  residency  sites  and  two  additional  site  visits 
were  conducted  by  an  Arts  Council  member  and  another  staff  member.  These  visits 
were  focused  on  the  residency  sponsor  and  did  not  include  the  multi-purpose  agenda  set  out 
in  FY  2004  to  include:  meeting  with  local  media;  and  talking  with  community  civic  and 
educational  organizations  and  leaders  about  the  value  of  arts  education. 

17.  Although  the  Arts  Education  program  emphasized  the  importance  of  media  coverage 
and  publicity  of  residency  activities  in  both  its  application  and  report  forms,  no 
progress  was  made  in  this  area.  If  MAC,  in  its  strategic  planning  process,  believes  local 
media  coverage  is  an  important  vehicle  for  promoting  the  arts  in  rural  Montana,  then  it  may 
need  to  re-assess  its  current  restrictions  on  grant  dollars  being  used  for  publicity  and  media. 

18.  Professional  development  for  both  visiting  artists  and  teachers  gained  new  emphasis  for 
the  Arts  Education  program  in  FY  2005.  Six  professional  development  workshops  were  held 
and  were  all  well  received  (evaluation  ratings  were  all  in  the  “good”  to  “outstanding” 
categories  with  the  majority  being  “outstanding”)  and  show  promise,  over  time,  to  improve 
the  quality  of  arts  residencies.  All  the  workshop  participants  commented  they  would  be 
interested  in  attending  other  professional  development  workshops  offered  by  MAC. 


II.  Recommendations  and  Consideratioiis  for  the  Arts 

Education  Program  Future 

1.  Stay  on  course  with  the  strategies  and  approach  to  Indian  reservations  schools  and 
communities  begun  in  FY  2005.  Continue  to  reach  out  to  develop  the  necessary 
relationships  and  be  flexible  and  creative  about  how  to  introduce  the  Arts  Education  program 
in  different  setting  and  areas. 

2.  Continue  to  offer  two-year  grants  to  exemplary  arts  organizations  and  schools 
employing  the  same  criteria  and  strategy  as  the  pilot.  Current  grantees  should  be 
encouraged  to  reapply.  Consider  expanding  it  beyond  four  grantees,  but  only  to  highly 
qualified  applicants. 

3.  Continue  to  provide  professional  development  opportunities  for  teaching  artists  and 
classroom  teachers  alike.  Target  workshops  to  areas  where  the  Arts  Education  program 
would  like  to  see  improvement,  as  the  agency  did  with  learning  objectives  and  evaluation. 
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4.  The  Arts  Education  program  has  done  an  excellent  job  of  distributing  its  resources  and 
programs  throughout  Montana,  not  just  in  the  more  populated,  easy  to  serve  areas.  In 
the  next  three  years  set  a goal  to  hold  at  least  one  residency  in  each  of  Montana’s  56 
counties. 

5.  The  Arts  Education  program  should  continue  its  successful  partnering  strategies  by 

both  creating  programs  with  new  partners  and  continuing  to  develop  working  relationships 
with  existing  ones. 

6.  Continue  to  emphasize  and  promote  the  schools/community  connections.  The  evaluation 
revealed  that  at  least  85%  of  the  school  residencies  included  an  event  that  involved  the  larger 
community. 

7.  Special  Projects  as  Incubator:  The  evaluation  identified  “special  project  grants”  as  a 
vehicle  to  fund  creative  projects  and  new  needs  in  arts  education  that  MAC  may  not  have 
time  and/or  staff  resources  and  expertise  to  develop  in  house.  Beginning  in  FY  2005  a 
specific  announcement  for  special  project  proposals  will  go  out  through  the  Arts  Education 
program’s  e-mail  distribution  in  the  fall  of  each  fiscal. 

8.  In  conjunction  with  the  agency’s  strategic  planning  process  carefully  assesses  how  and 
to  what  extent  MAC  should  take  leadership  and  responsibility  to  continue  to  develop 
the  Statewide  Players  Arts  Education  Network. 

9.  There  are  real  limits  to  what  the  Arts  Education  program  can  do  well  with  its  current 
human  and  financial  resources  and  the  program  has  reached  them.  As  noted  earlier  in 
this  report,  the  Arts  Education  program  is  operating  near  maximum  capacity.  Certainly  the 
Arts  Education  program  strategy  of  partnering  can  expand  resources  and  should  be 
continued.  But,  to  plan  or  launch  any  new  program  initiative  will  take  new  sources  of  money. 

10.  In  FY  2006,  MAC  will  engage  in  another  strategic  planning  process  that  will  provide 
the  agency-wide  direction  and  context  that  can  help  to  focus  and  prioritize  components 
and  initiatives  within  the  Arts  Education  program.  Several  key  questions  raised  by  this 
evaluation  that  should  be  decided  within  the  larger  agency  priorities  include: 

■ What  level  of  time  and  resources  should  go  to  organizing  the  Statewide  Players  Arts 
Education  Network?  What  does  the  agency  see  as  their  role  and  value  over  time? 

■ What  level  of  time  and  resources  should  be  put  into  serving  reservation  schools  and 
communities?  What  other  minority  groups  should  the  Arts  Education  program  be 
focusing  on  (Hmong,  Mexican  American  migrant  populations,  etc.)? 

■ What  should  be  the  commitment  of  MAC  staff  to  bring  in  specific  program  dollars  from 
outside  sources?  What  is  the  desired  mix  of  funding? 

■ What  are  MAC’S  assumptions  and  analysis  about  the  shifts  and  trends  in  Montana  school 
funding?  Does  MAC  want  to  play  in  this  arena,  advocating  for  the  arts  in  the  schools? 

■ How  critical  is  it  for  the  Arts  Education  program  to  engage  community  leaders  and  the 
local  media  in  conjunction  with  residency  site  visits?  What  should  be  the  responsibility 
of  MAC  staff  to  act  in  this  agency  ambassador  role? 
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